U nder the Paperwork 



PTO/SB/05 (4/98) 
Approved for use through 09/30/2000. 0MB 0651-0032 — 
Patent and Trademark Office: U.S DEPARTMENT OF COMMERCE 
Reduction Act of 1995. no persons are required to respond to a collection of information unless it displays a valid 0MB control rmmber^ 



Please type a plus sign (+) inside this box | 4* | 



UTILITY 
PATENT APPUCATION 
TRANSMITTAL 



pnly for new nonprovisionat appfications under 37 C.F.R § t$3(t?}) Express Mai! Label No. 



Attorney Docket No. 



29236.4 



First fnventor or Application Ider^tifier 



Title 



Paul Robert Wiliiams 



METHOD AND SYSTEM FOR ELIMINATION OF ACOUSTIC FEEDBACK 



EL417818452US 



APPLlCATiON ELEMENTS 

See MPEP chapter 600 concarntng utility patent application contents 



Assistant Commissioner for Patents OU^ 
ADDRESS TO: Box Patent Application ol> 



2. 



to 



* Fee Transnnittal Form (e.g., PTO/SB/17) 
(Submit an original and a duplicate for fee processing) 

Specification [Total Pages 

(preferred arrangement set forth bebw) 
~ Descriptive title of the Invention 

- Cross References to Related Applications 

- Statement Regarding Fed sponsored R&D 

- Reference to iVIicrofiche Appendix 

- Background of the Invention 

- Brief Sunnnnary of the Invention 

- Brief Description of the Drawings (if filed) 

- Detailed Description 

- Claim(s) 

- Abstract of the Disclosure 
Drawing(s) (35 US.C. 1 13) [Total Sheets I 13 



I I Microfiche Conaputer Program (Appendix) 3 

Nucleotide and/or Amino Acid Sequence Submission co_ 
{If ap plicabl e, all necessary) 

a. I I Computer Readable Copy 

b. I I Paper Copy (identical to computer copy) 

c. I I Statement verifying identity of above copies 



3- H 

4. Oath or Declaration 



[Total Pages] 2 



10 



11 



I I Newly executed (original or copy) 

□ Copy from a prior application (37 C.F.R. § 1.63(d)) 
(for continuation/divisional with Box 16 completed) 



□ 



DELETION OF INVENTOR(S) 
Signed statement attached deleting 
inventor(s) named in the prior application 
see 37 C.F.R. §§ 1.63(d)(2) and 1.33(b). 



\* NOT£J=OR ITEMS 1 & 13 : IN ORDER TO BE ENTITLED TO PAY SMALL BHTITY 
\FEES, A SmLL ENTfTY STATEMENT tS REQUIRED (37 CF.fL § 1.27), EXCEPT 
I r ONE FILED m A PRIOR APPUCATION IS RELIED UPON (37 C.F.R. 4 1.28). _ 



ACCOMPANYING APPLICATfON PARTS 



13 



14 



15 



I I Assignment Papers (cover sheet & document(s)) 

□ 37 C.F.R.§3.73(b) Statement | I Power of 
(when there is an assignee) I I Attorney 

I I English Translation Document (if applicable) 

□ Information Disclosure I | Copies of IDS 
Statement (IDS)/PT0-1 449 I I Citations 

I I Preliminary Amendment 

12 nn ^^^^^^ Receipt Postcard (MPEP 503) 
I I (Should be specifically itemized) 
* Small Entity 

Status still proper and desired 



n* Small Entity | . statement filed in prior application 
Statement(s) | | 

□ 



(PTO/$B/09-12) 
Certified Copy of Priority Document(s) 
(if foreign priority is claimed) 

Other: JE?^m§.s.MaiL,QMti.Qate... 



16. If a CONTINUING APPLlCATiON, check appropriate box, and supply the requisite information below and m a preliminary amendment- 

I I Continuation Q Divisional Q Continuation-in-part (CI P) of prior application No: „/ „ , .„ 

Pnor application information: Examiner . Group /Art Unit: , . — 

For CONTfNUATtON or DIVISIONAL APPS only : The entire disclosure of the prior application, from which an oath or declaration is supplied 
under Box 4b, is considered a part of the disclosure of the accompanying continuation or divisional application and is hereby incorporated by 
reference- The incorporation can only be relied upon when a portion has been inadvertently omitted from the submitted application parts. 



17. CORRE^^^^^ 



n Customer Number or Bar Code' Label 



or E! Correspondence address below 



(Insert Customer No. or Attach bar code label here) I 



Name 



David !<• McCombs 



Haynes and Boone, L.L.P. 



Address 



901 Main Street, Suite 3100 



City 



Dallas 



state 



Texas 



Zip Code 



75202-9918 



Country 



USA 



Telephone 



214-651- 



Fax 



214-651-5940 




BurdenHoITstatement^l^^ individual case Any 

comments on the amount of time you are required to cofrtplete this form should be sent to the Chief Infomnation Officer, Patent and Trademark Office, 
Washington, DC 20231 . DO NOT SEMD FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO. Assistant Commissioner for Patents, 
Box Patent Application, Washington, DC 20231 . 



Un der the Paperwork 



PTO/SB/17 (12/99) 
Approved for use through 09/30/2000 0MB 065 1 -0032 
Patent and Trademark Office: U S. DEPARTMENT OF COMMERCE 
Reduction Act of 1995. no persons are required to respond to a coHection of information unless it displays a valid OMB control number. 



FEE TRANSMITTAL 
for FY 2000 

Patenf fees are subject to annua} revision. 
Small Entity paymer}ts must be supported by a small entity statement, 
ottierwise large entity fees must be paid See Forms PTOJ $8/09-1 2. 

See 37C.F.R §§ 1.27 and 1.28. 



Complete if Known 



Application Nunnber 



Filing Date 



First Named inventor 



Examiner Name 



TOTAL AMOUNT OF PAYMENT 



($) 



690.00 



Group / Art Unit 



Attorney Docket No. 



Herewith 



o 



Paul Roberl Williams 



n/a 



n/a 



29236.4 



CO" 



METHOD OF PAYMENT (check one) 



FEE CALCULATION {continued) 



0 



I — I The Commissioner is hereby authorized to charge 



indicated fees and credit any overpayments to: 



Deposit 
Account 
Number 

Deposit 
Account 
Name 



08-1394 



3, ADDITIONAL FEES 

Large Entity SmatI Entity 
Fee Fee Fee Fee 
Code ($) Code ($) 



Fee Description 



Fee Paid 



Haynes and Boone LLP 



S Charge Any Addillona I Fee Required 
Under37CFR§§ 1.16 and 1 17 



2. n Payment Enclosed: 

s Check na? Qo^- 



FEE CALCULATION 



1. BASIC FILING FEE 

Large Entity Small Entity 

Fee Fee Fee Description 
Code ($) 

201 345 



Fee Fee 
Code ($) 

101 690 

106 310 

107 480 

108 690 
114 150 



Fee Paid 



Utility filing fee 

206 155 Design filing fee 

207 240 Plant filing fee 

208 345 Reissue filing fee 
75 Provisional filing fee 



214 



690 



SUBTOTAL {1} 



($) 69Q.QQ 



2. EXTRA CLAIM FEES 

Fee from 

Ext ra Ciaim g below Fee Paid 
Total Claims I (p I -20- j ^ I X I — I A 0-00 I 
^dependent |-Q , 3.. .["^ ^ F"^ ^0001 

Multiple Dependent [ — [ H 

"^or number previously paid, if greater: For Reissues, see below 
Large Entity SmalJ Entity 

Fee Fee Fee Fee Fee Description 

Code {$) Code ($} 

103 18 203 9 Claims in excess of 20 

102 78 202 39 Independent claims in excess of 3 

104 260 204 130 Ivtuttiple dependent claim, if not paid 
109 78 209 39 



105 


130 


205 


65 


Surcharge - iate filing fee or oath 


127 


50 


227 


25 


Surcharge - late provisional filing fee or 
cover sheet. 


139 


130 


139 


130 


Non-English specification 


147 2.520 


147 2,520 


For filing a request for reexamtnaUon 


112 


920* 


112 


920* 


Requesting publication of SIR prior to 
Exanniner action 


113 


1,840-^ 


113 


1 640* Requesting publication of SIR after 
Examiner action 


115 


110 


215 


55 


Extension for repiy within first month 


116 


380 


216 


190 


Extension for reply within second month 


117 


870 


217 


435 


Extension for reply within third month 


118 


1,360 


218 


680 


Extension for reply within fourth month 


128 


1.850 


228 925 


Extension for reply wlthm fifth month 


t19 


300 


219 


150 


Notice of Appeal 


120 


300 


220 


150 


Filing a brief in support of an appeal 


121 


260 


221 


130 


Request for oral hearing 


138 


1.510 


138 1,510 


Petition to institute a pubtic use proceeding 


140 


110 


240 


55 


Petition to revtve - unavoidable 


141 


1.210 


241 


605 


Petition to revive - unintentional 


142 


1.210 


242 


605 


Utility issue fee (or reissue) 


143 


430 


243 


215 


Design issue fee 


144 


580 


244 


290 


Plant issue fee 


122 


130 


122 


130 


Petitions to the Commissioner 


123 


50 


123 


50 


Petitions related to provisional applications 


126 


240 


126 


240 


Submission of Information Disclosure Stmt 


681 


40 


581 


40 


Recording each patent assignment per 
property (times numijer of properties) 


146 


690 


246 


345 


Filing a submission alter final rejection 
{37 CFR§ 1129(a)) 


149 


690 


249 


345 


For each additional invention to be 
examined {37 CFR § 1.129(b}) 



110 18 210 



* Reissue independent claims 
over origmal patent 

* Reissue claims m excess of 20 
and over original patent 



other fee (specify) . 
other fee (specify) , 




Information on this form may become public. Credit card information should not be 
included on this form. Provide credit card information and authorization on PTO-2038. 

Burden Hour Statement: This form is estimated to take 0.2 hours to complete. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of time you are required to complete this form should be sent to the Chief Information Officer. Patent and Trademaric Office. Washington. DC 20231 
DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents. Washington, DC 20231. 

d789702.1 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re application of: Paul Robert Williams 



§ 
§ 
§ 
§ 
§ 
§ 
§ 
§ 
§ 



Docket Number: 29236.4 



Serial No.: N/A 



Group Art Unit: Unknown 



Filed: Herewith 



Examiner: Unknown 



For: 



METHOD AND SYSTEM FOR 
ELIMINATION OF ACOUSTIC FEEDBACK 



Box Patent Application 
Commissioner for Patents 



Washington, D.C. 20231 



EXPRESS MAIL CERTIFICATE 



Express Mail Number: EL417818452US 
Date of Deposit: September 9. 2000 

I hereby certify that the following attached papers and fee: 

1 . Utility Patent Application Transmittal Sheet (in duplicate); 

2. Fee Transmittal Sheet (in duplicate) 

3. Patent Application consisting of: W pages of Specification, (p Claims, 1 page of Abstract; 

4. 13 Drawing sheets; 

5. Unsigned Declaration and Power of Attorney; 

6. Check in the amount of $690.00 for filing fee; and 

7. Return Postcard. 

are being deposited with United States Postal Service "Express Mail Post Office to Addressee" to the 
Commissioner for Patents, Box Patent Application, Washington, D. C. 2023 1 . 

Bill R. Naifeh 




D-818051.1 



Attorney Docket No. 29236.4 



METHOD AND SYSTEM FOR ELIMINATION 
OF ACOUSTIC FEEDBACK 

Inventor: Paul Robert Williams 
75 Lime close 
Stevenage 
Hertfordshire 
SG2 9QB 
England 

Citizenship: United Kingdom 



Assignees: Harman International Industries Limited 
A company registered in England 
Registration number 1485558 
Registered office: 

4th Floor 

Windsor House 

Pepper Street 

Chester 

CHI IDF 

United Kingdom 



HAYNES AND BOONE, LLP 
901 Main Street, Suite 3100 
Dallas, Texas 75202-3789 
(214) 651-5000 
Attorney Docket No. 29236.4 
Document # D-818515.2 



-1- 



Attorney Docket No. 29236.4 



FXPRESS MAIL NO.: H L4 17 ^ I ^ 2 i IS DATE OF DEPOSIT: 



This paper and fee are being deposited with the U.S. Postal Service Express Mail Post Office to Addressee 
service under 37 CFR §1.10 on the date indicated above and is addressed to the Commissioner for Patents, 
Washington, D.C. 20231 



Name of person mailing paper and fee 




METHOD AND SYSTEM FOR ELIMINATION 
OF ACOUSTIC FEEDBACK 

5 

Technical Field of the Invention 

The present invention relates to sound systems where a microphone in 
the vicinity of a loudspeaker might give rise to acoustic feedback. 

10 

Background 

In sound systems, there is some acoustic coupling between a loud 
speaker, an ampHfier, and a microphone so that the entire system forms a 
closed loop. If a feedback ratio, or "loop gain," exceeds a certain threshold, 

15 the system will oscillate, or "ring," and acoustic feedback will occur. This 
feedback will persist until something is done to reduce the loop gain. 

Many sound systems rely on an operator who can determine the 
presence of acoustic feedback and react before the resonance builds and 
becomes alarming to the audience, or before equipment damage takes place. 

20 The operator normally either reduces the system gain, or manually applies 
some filtering at a resonant frequency using an equalization device. 
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The role played by the operator in maintaining system stability 
against feedback would not be necessary if the system had the ability to 
detect its own feedback and upon detection, to reduce the loop gain of the 
system at that particular frequency until the ringing ceased. Accordingly, 
5 there is a need for a system or method that can detect the presence of 
acoustic feedback and automatically reduce the gain at a particular frequency 
or frequencies. 

Summary of the Invention 

10 The present invention provides a method and system for eliminating 

acoustical feedback. In one embodiment, the method includes determining at 
least one parameter for at least one notch filter, adjusting the notch filter 
based on the parameter, processing the digital signals through the notch 
filter, testing the effect of the notch filter in the system, and removing the 

15 notch filter if the notch filter is not effective. 

In some embodiments, the method also includes selecting candidate 
feedback frequencies, as opposed to other desirable sound frequencies. The 
selection method may include converting the time domain digital signal 
samples by a Fourier transform algorithm into the frequency domain, using a 

20 ballistics approach to find persistent prominences in the frequency spectrum, 
and testing the prominences. 

Brief Description of the Drawings 

Fig. 1 is a functional block diagram of a sound system incorporating 
25 one embodiment of the present invention. 

Fig. 2a is a functional block diagram of one embodiment of a digital 
processor used in the present invention. 
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Fig. 2b is a functional block diagram of an alternative embodiment of 
a digital processor used in the present invention. 

Fig. 3 is a process flow diagram illustrating the processing performed 
by the digital processor. 
5 Fig. 4 is a functional block diagram illustrating the functional 

relationships of the primary processing blocks of one embodiment of the 
present invention. 

Fig. 5 is a process flow diagram illustrating one embodiment of the 
candidate selection process. 
10 Fig. 6 is a process flow diagram illustrating the one embodiment of the 

ballistics selection process. 

Fig. 7a is an illustration of the results of one embodiment of the 
ballistics selection process. 

Fig, 7b is an illustration of the results of one embodiment of the 
15 ballistics selection process. 

Fig. 8 is a process flow diagram illustrating one embodiment of the 
threshold discrimination process. 

Fig. 9 is a graphical representation of an illustrative frequency 
spectrum which may be typical of the output of one embodiment of the 
20 present invention. 

Fig. 10 is a process flow diagram illustrating one embodiment of the 
assignment process. 

Fig. 11 is a process flow diagram illustrating one embodiment of the 
state machine process. 
25 Fig. 12a is a graphical representation of a sinusoidal signal shown in 

the time domain. 

Fig. 12b is a graphical representation of a sinusoidal signal shown in 
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figure 12a transformed into the frequency domain. 

Fig. 13a is a graphical representation of an illustrative signal in the 
time domain. 

Fig. 13b is a graphical representation of the illustrative signal shown 
5 in figure 13a transformed into the frequency domain. 

Description of the Preferred Embodiment 

The present disclosure discusses a method and system for eliminating 
acoustic feedback. It is understood, however, that the following disclosure 

10 provides many different embodiments, or examples, for implementing 
different features of the invention. Specific examples of components and 
arrangements are described below to simplify the present disclosure. These 
are, of course, merely examples and are not intended to limit the invention 
from that described in the claims. 

15 Referring to Fig. 1, a sound system 100 includes at least one 

microphone 102 that generates electrical signals. The electric signals 
represent audio signals that are sampled at a given rate (e.g., every 21 
microseconds) by a conventional analog to digital converter (ADC) 104. The 
ADC 104 converts the sampled signals from the microphone into digital 

20 samples and sends the digital signals to a digital processor 106. The 
processor 106 removes any feedback signals from the sound signals and 
outputs processed digital signals to a conventional digital to analog converter 
(DAC) 108. The DAC 108 creates analog electrical signals that are sent to a 
conventional amplifier 110. Amplifier 110 drives a loudspeaker 112 to create 

25 acoustic signals that are free of acoustic feedback. 

Referring to Fig. 2A, in one embodiment, the processor 106 includes a 
digital signal processor ("DSP") 202 that is coupled to a non-volatile memory 
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204 for storing program instructions. The DSP 202 is also coupled to a 
random access memory ("RAM") 206 for storing signals received from ADC 
104. 

Referring also to Fig. 2b, if the processor 106 is incorporated into a 
5 product with its own microprocessor, for instance in a loudspeaker controller, 
a DSP 212 could be coupled to a microcontroller 210. Such an arrangement 
allows for sharing of resources and functions. In Fig. 2b, the DSP 212 is 
coupled to its own RAM 214 for data storage. The microcontroller 210 is also 
coupled to a RAM 216 and non-volatile memory 218. The non-volatile 

10 memory 218 can be in the form of flash memory or read only memory 
("ROM"). In this embodiment, program instructions may be stored in the 
non-volatile memory 218, and then loaded during a startup process into the 
appropriate RAM (e.g., RAM 214, RAM 216, or both). 

Fig. 3 is one embodiment of a process flow diagram illustrating the 

15 signal processing steps performed by a digital processor 106 (Fig. 1). In step 
302, the processor 106 receives a new digital signal from the ADC 104 every 
few microseconds (e.g. 21 microseconds). In step 304, these digital samples 
are stored in a circularized buffer in RAM 206 (Fig 2A). In step 306, a 
process is run on the signals stored in the buffer to determine notch filter 

20 parameters. This process 306 may be performed at certain intervals, such as 
every 85 milliseconds. In step 308, using the notch filter parameters, the 
signals are processed through a series of one or more notch filters operating 
in the time domain using the filter parameters determined in step 306. A 
"notch filter" is a filter that rejects (attenuates) a frequency band and passes 

25 a lower frequency band and a higher frequency band. After the notch filters 
are applied, in step 310, the signals are sent to the DAC 108 (FIGURE 1). 

The signals are filtered and processed at one processing rate (steps 
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302, 304, 308, and 310), but the notch filter parameters may be determined 
at a different processing rate (step 306). Thus, there may be two processing 
flows which is graphically illustrated in Fig. 4. 

In Fig. 4, flow line 402 represents the processing and filtering of the 
5 audio signals. The signals processed along flow line 402 are received and 
processed by notch filters 407 at one processing rate (e.g., one signal every 21 
microseconds). However, the processing for determining the notch filter 
parameters are processed at a different rate (e.g., one signal every 85 
milliseconds). This processing is represented by flow line 404. Circular 

10 buffer 405 stores copies of the digital signals processed along flow line 402 so 
that they can be processed at a slower rate along flow line 404. 

Conceptually, the process of determining the notch filter parameters 
can be divided into two major processes, each process comprising a series of 
subroutines or sub-processes. A first process is the candidate frequency 

15 selection process 406. A second process is the implementation process 408. 
As will be explained in detail later, the candidate frequency selection process 
406 uses a Fast Fourier Transform ("FFT") subroutine 410, a magnitude 
squared subroutine 412, a ballistics process 414, a prominence search routine 
416 and a threshold detection process 418. 

20 The implementation process 408 uses an assignment process 420, a 

series of state machine routines 422, which are coupled with filter parameter 
generation processes 424. Once the candidate frequencies are selected by the 
frequency selection process 406, the implementation process 408 tests 
candidate frequencies by applying a corresponding notch filter at the 

25 candidate frequencies in the sound signal in flow path 402 at one or more 
notch depths over time, A "notch depth" is the amount of filtering (i.e., 
reduction in amplitude, usually described in decibels) at a particular 
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frequency. If there is good correlation between the trial filter depth changes 
and the recorded amplitude changes, then the frequency is determined to be 
the result of acoustic feedback. In this case, one or more of the notch filters 
407 are left in the flow path 402 at a predetermined notch depth. If there is 
5 poor correlation, then the frequency is determined to be a result of a wanted 
signal (e.g. music or speech etc), so the notch filter is removed. 

As those who are skilled in the art will appreciate, sound signals are 
converted into digital signals in the time domain, but spectral analysis and 
discriminations are often performed in the frequency domain. A process 

10 known as a discrete Fourier Transform is one method of converting a signal 
from the time domain to the frequency domain. A Fast Fourier Transform 
("FF'P') is an efficient and well known algorithm for calculating the discrete 
Fourier Transform of a signal. 

Figs. 12a and 12b can be used to illustrate the function of a FFT. Fig. 

15 12a is a plot showing magnitude of an analog sinusoidal signal 1202 of fixed 
frequency plotted against time (i.e., in the time domain). The analog signal 
1202 can be converted to a digital signal by the ADC 104, which samples the 
signal at discrete instances in time (along the x-axis) with a fixed internal 
1206 between the samples. Such samples are represented in Fig. 12a as 

20 number vertical lines 1204. The samples may then be converted into the 
frequency domain by means of the FFT to determine the frequency 
components of the signal in a discrete manner. For simplicity, the signal 
1202 is shown sampled at an interval 1206 that provides 16 sample points 
per time segment, or FFT frame. The preferable number of sample points is 

25 a number that is a power of two. The greater the sample points per segment, 
the greater the discrimination and filtering capability. The present invention 
uses 4096 sample points per time segment. 
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Utilizing the FFT algorithm, each segment or "frame" of the time 
domain signal can be converted into the frequency domain. The number of 
discrete frequency components which can be distinguished in the frequency 
domain is equal to half the number of samples in the segment. For the 
5 example of Fig. 12a, the Fast Fourier Transform of each segment of the 
signal is distinguishable into sixteen different evenly spaced frequency 
components for a given frequency band. When the frequency spectrum is 
expressed in hertz, the frequency band runs from 0 to one-half of the actual 
sampling rate. 

10 Fig. 12b is a graphical representation of the time domain signal of Fig. 

12a transformed into a frequency spectrum (i.e., the frequency domain) by a 
FFT analysis. Fig. 12b shows a plot indicating the relative magnitude (i.e., 
the vector of the real and imaginary components) of the signal at a particular 
frequency. The relative sizes of these components are determined from the 

15 phase of the sinusoid relative to the FFT frame. Because the signal 1202 is a 
sine wave of fixed frequency, the corresponding frequency domain plot has 
only one frequency component, namely, a component at frequency f. 

Fig. 13a is another example illustrating a complex time domain signal 
1302. Fig. 13b is a frequency spectrum 1304 of the signal 1302 illustrated in 

20 Fig. 13a, The vertical y-axis of Fig. 13b represents the relative magnitude of 
the signal 1304 at a particular frequency on the horizontal x-axis. As those 
skilled in the art will appreciate, the FFT produces arrays representing the 
real and imaginary components of each segment of the frequency response. 
These output arrays are known as "bins" and typically represent the relative 

25 magnitude of the energy for the signal within a discrete frequency range. 
Therefore, each bin or "frequency bin" represents a fixed width of the 
frequency spectrum. 
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When a typical signal is converted into the frequency domain by the 
FFT, this signal has frequency components divided into bins representing the 
entire frequency spectrum. A frequency spectrum or FFT "frame" is the 
array of output bins produced for any given time segment. A new FFT frame 
5 can be produced at regular intervals. 

Turning now to Fig. 5, the candidate frequency selection process 406 is 
illustrated in more detail. The candidate frequency process 406 selects 
candidate frequencies and, then discriminates or eliminates many of the 
initial candidate frequencies. Too many candidate frequencies would disrupt 
10 the audio signal to an unacceptable degree. 

Once a predetermined number of new signals have accumulated in a 
signal storage buffer (e.g., a predetermined portion of RAM 206 or RAM 216), 
in step 502, the signal information in the buffer is processed using a Fast 
Fourier Transform algorithm (FFT). In one embodiment of the present 
15 invention, a FFT is run once every 4096 samples, and produces 4096 bins per 
FFT frame. The rate at which FFTs are run is l/4096th of the sample rate, 
or about 85milliseconds. This effectively produces a sample rate of 11.7Hz 
for FFT processing. The FFT transforms the time domain signal into a pair 
of arrays of FFT bins representing the real and imaginary components of the 
20 signal in the frequency domain. 

In step 504, half of the real and imaginary output arrays from the FFT 
are combined by summing the squares of each to produce an array of bins 
representing the magnitudes squared. The other half is a redundant mirror 
image. Thus, in the present embodiments, 2048 magnitude-squared values 
25 are stored for later analysis. 

In step 506, all the "magnitude squared bins" are averaged into a 
Mean-Square value, or a mean value of the magnitude -square values. Such a 



-10- 



Attorney Docket No. 29236.4 

value is a measure of the energy of the signal during the current FFT frame. 

This value can be used as a reference of the energy of the overall signal 

against which the feedback energy can be compared by examining the ratios 

between them. As those skilled in the art will appreciate, the ratios can be 
5 compared with either squared or linearly represented data. Consequently, 

the present invention should not be interpreted as being limited to analyzing 

data based only on "squared data." 

In step 508, the ballistics process 414 is then applied to the magnitude 

squared bins or "frequency magnitude bins." The ballistics sub-process is 
10 actually a bank of digital filters operating in the (frame rate) time domain on 

each FFT bin. For each frequency magnitude bin, a running average value of 

past bin values can also be kept in memory. 

Fig. 6 provides one example of a ballistics process, such as may be used 

by the ballistics process 414. In step 602, the new value of the frequency 
15 magnitude bin ("NEW_VALUE") is compared to the previous value from 

previous FFT frames ("OLD_VALUE"). If the NEW_VALUE is less than the 

OLD_VALUE, then the OLD_VALUE is set to the NEW_VALUE in step 604. 

On the other hand, in step 606, if the NEW_VALUE is greater than the 

OLD__VALUE, the OLD_VALUE is set to the following first order filtering 
20 equation: 

OLD_VALUE = (NEW_VALUE - OLD_VALUE)*K + OLD_VALUE. 
Where K is the filtering coefficient according to the equation: 

K= l-(l-Threshold)^(l/(t*Ffs)) 
Where t is the time value to reach threshold, for example 1 second, the 
25 Threshold is the fractional value for which the time value is calibrated, for 
example 0.5, and Ffs is the frame sample rate, for example 11.7Hz 

Such filtering is only applied when the NEW_VALUE from the FFT is 
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greater than the OLD_VALUE in memory. In step 608, when the 
NEW_VALUE from the FFT is less than the OLD_VALUE in memory, the 
value in memory is replaced by the NEW_VALUE from the FFT. The result 
causes higher values (attack phase) to build up in the memory over time, 
5 whereas lower values (release phase) are reflected in the memory instantly 
(zero release time). 

The operation of the ballistics subroutine as it performs multiple 
iterations can be illustrated graphically in Figs. 7a and 7b, Fig. 7a 
illustrates a graph of a ballistics output or response 702 ("OLD_VALUE'0 of 

10 a single FFT bin with a music signal plotted over time. The rapidly changing 
music signal causes the "OLD_VALUE" to "release" or decrease as the signal 
varies. Fig. Ih, on the other hand, illustrates a graph of a ballistics response 
704 with a feedback signal. Lingering tones, such as feedback signals, will 
build up over time. As can be seen, the magnitude of the "OLD_VALUE" 

15 steadily increases to a threshold value over several FFT frames. Thus, the 
individual frequency bins can be said to have an "attack" or "ballistic" 
characteristic applied which causes "prominences" to gradually build for the 
frequency signals that persist, such as feedback signals. 

A longer time-constant can be applied to frequency bins representing 

20 the lower sound frequencies. The use of a longer time-constant helps to 
discriminate against bass notes which often persist, without degrading the 
response time to attenuate high frequency feedback, which often builds up 
faster, is more alarming, and potentially more damaging. The present 
embodiments use a time-constant of 2 seconds at the low-frequency end and a 

25 time-constant of 200 milliseconds at the high frequency end. The time- 
constant is defined as the time taken to reach 6dB below the threshold value 
(i.e., 0.5 of the target value). After the OLD„VALUE is stored for each 
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frequency bin at step 608, the ballistics subroutine ends. 

Referring again to Fig. 5, upon completion of the ballistics process 414 
at step 508, execution proceeds to step 510. In step 510, the prominence 
search routine 416 selects a predetermined number "N" of the highest 
5 "OLD_VALUEs" or "prominences" from the output of the ballistic process 
414. The present embodiment uses N^six as a predetermined number, but 
any predetermined number could be used. 

In step 512, the amplitude (i.e., magnitude stored in the frequency bin) 
and the frequency bin number (indicating the frequency) of these N highest 

10 prominences are then passed to the threshold detection process 418. The 
threshold detection process 418 assures that the prominences are at least a 
predetermined magnitude (i.e. is must be loud enough to cause problems), 
and a predefined amount above the mean squared value (i.e. is the feedback 
frequency significant compared to the level of music/background noise). 

15 Fig. 8 describes one embodiment of the threshold detection process 

418. In step 802, a relative threshold variable ("RELATIVE_THRESHOLD") 
is computed according to the following formula: 



20 



IlELATIVE„THRESHOLD=MEAN„SQUARE*RELATIVE_MULTIPLIEIl 



Where the RELATIVE_MULTIPLIER is a predetermined amount. The 
present invention uses a RELATIVE_MULTIPLIER of (L/150)^2, where L is 
the length of the FFT, for example 4096. However, if actual magnitude 
values were used rather than square values, the multiplier would be (L/150). 
25 The value of the mean MEAN„SQUARE variable has been determined 
previously in step 506 (Fig. 5). 

In step 804, the magnitude of the frequency bin under consideration is 
compared to an ABSOLUTE„THRESHOLD variable. One embodiment sets 
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this variable at a value equivalent +85dB SPL at a distance of 1 meter from 
the loudspeaker. If the frequency bin magnitude is less than the 
ABSOLUTE_THRESHOLD, that frequency bin is not considered to be a 
candidate for frequency feedback and the subroutine logic continues to step 
5 810, Step 810 sets a flag indicating that the frequency bin under 
consideration should not be considered to be a candidate frequency. Thus, 
the test performed in step 804 will only allow a frequency to be considered a 
candidate if the magnitude of its bin exceeds a certain volume. This prevents 
low-level signals from being further processed, even if the cause is feedback, 
10 on the basis that feedback which is barely audible is probably not worth 
filtering. 

If at step 804 the frequency bin magnitude is greater than the 
ABSOLUTE_THRESHOLD, than the subroutine logic continues to step 806 
where a comparison is made between the frequency bin magnitude and the 

15 RELATIVE„THRESHOLD (computed in step 802). If at step 806 the 
frequency bin magnitude is less than the RELATIVE_THRESHOLD, then 
that frequency bin is not considered to be a candidate for frequency feedback 
and the subroutine logic continues to step 810. Otherwise, execution 
proceeds to step 808, where a flag is set indicating that the frequency bin 

20 should be considered to be a candidate frequency. The test of step 806 only 
allows a frequency to be considered a candidate if the amplitude of its bin 
exceeds the average bin level by a given amount. This prevents feedback 
from being attenuated, which is already hidden by wide-band signals and is 
thus not doing any harm. This also helps to discriminate feedback from 

25 wanted signals since it will favor pure tones. In other words, the prominence 
is sufficiently below the rest of the sound spectrum so that it will not be 
discerned. 
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Thus, only prominences that are above both of these thresholds (i.e., 
RELATIVE_THRESHOLD and ABSOLUTE_THRESHOLD) are then 
considered to be candidate frequencies. This concept is illustrated 
graphically in Fig. 9. Fig 9 shows a frequency spectrum indicating an 
5 absolute threshold level 902, a relative threshold level 904, and a mean- 
square level 906 (which is used to calculate the relative threshold 902). A 
prominence 908 would be passed on as a candidate for future consideration 
because its magnitude is greater than both the absolute threshold 902 and 
the relative threshold 904. Prominence 910 would not be passed on as a 

10 candidate frequency because the magnitude of prominence 910 is not greater 
than the absolute threshold level 902. 

Referring again to Fig. 5, if at step 512 the candidate frequencies meet 
the conditions of the threshold detector subroutine, they are passed to the 
implementation process 408 in step 514. As previously discussed, the 

15 implementation process 408 tests of the candidate frequencies by testing the 
effect of a notch filter on the candidate frequency. One embodiment of the 
implementation process 408 uses assignment process 420 to assign a state 
machine subroutine to each candidate frequency. After the candidate 
frequencies are assigned to one of the state machine routines 422, the 

20 appropriate state machine algorithm is executed. 

One embodiment of the assignment process 420 is control scheme that 
runs the state machine subroutines in succession from zero to the last state 
machine routine. (There are N state machines for N notch filters because one 
state machine controls one notch filter). One embodiment of this routine uses 

25 6 filters. Any number of filters, however, could be used. For each candidate 
frequency, the assignment process 420 searches all state machine routines, if 
the candidate frequency is already in use, the candidate frequency is 
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assigned to the same state machine routine. If the candidate frequency is not 
already in use, the candidate frequency is assigned to the first free state 
machine routine. 

Fig. 10 illustrates one embodiment of the assignment process 420. In 
5 step 1002, a filter counter is set to zero. In step 1003, a flag 
FREQUENCY_ASSIGNED is set to false. In other words, it is assumed that 
the new candidate frequency has not yet been assigned to the current notch 
filter. 

In step 1004, the state machine subroutine assigned to the current 

10 filter is executed. Step 1006 determines whether the filter counter has 
incremented to the last filter number (i.e., "N'O, if it has, then the assignment 
process 420 exits. If not, then step 1007 determines whether the flag set for 
the candidate frequency in step 1003 is still false. (In other words, has the 
appropriate state machine routine changed the flag?) If the flag is set to 

15 true, then the candidate frequency has already been assigned and the routine 
exits. If not, the filter counter is incremented in step 1008, and the program 
logic returns to step 1004. 

The state machine routines 422 which are individually assigned to the 
candidate frequencies causes each candidate frequency is to be "tested" by 

20 setting the associated notch filter to the appropriate candidate frequency at a 
given attenuation depth and bandwidth. There is a state machine subroutine 
associated with each of the N notch filters so that the current status of each 
filter can be tracked. The state machine routines track when each notch 
filter is idle (ready for a new assignment), when the filter is testing a trial 

25 notch, and when the filter is engaged in feedback suppression (i.e. not longer 
a candidate since feedback discrimination has been successful). If, after a 
predetermined test time, the measured amplitude at the candidate frequency 
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has been reduced by a predetermined minimum amount, then genuine 
feedback is said to have been detected, and the filter is left in place at a 
predetermined depth, otherwise the filter is canceled. 

The logic used by one embodiment of the state machine routine is 
5 illustrated in Fig. 11. The candidate frequency is passed to the state 
machine. In step 1102, a state flag is checked to determine whether or not it 
is in a testing state for the candidate frequency passed to the state machine 
routine. If the state flag has been set, a check in step 1104 is run against a 
timer routine to determine whether a time limit for the state machine has 

10 expired. One embodiment of the present invention uses a time limit of 500 
milliseconds. The timer may be a software routine used to measure time 
intervals. Such routines are well known to those who practice the relevant 
art. In one embodiment of the present invention, the timer could simply be a 
counter to count FFT frames because the frames are processed at regular 

15 intervals. 

If the time limit has not expired (step 1104), the notch filter is still in a 
testing state. The subroutine terminates and no action is taken. If the time 
limit has expired, the current bin magnitude for the frequency is retrieved in 
step 1106. 

20 In step 1108, the magnitude is checked to see if it has been sufficiently 

reduced by comparing the reduction in magnitude at the candidate frequency 
to a predetermined value: TESTDROP. In one embodiment, TESTDROP is 
3dB. If the magnitude for the candidate frequency has not been reduced by 
TESTDROP, the candidate frequency is not likely to be feedback. 

25 Consequently, the parameters of the notch filter are set to "bypass" in step 
1110 (which can also be done by setting the notch depth to 0 db causing the 
filter to have no effect on the audio signal.) The idle state flag is set in step 
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1112. 

Once the TESTDROP comparison has failed, the filter bypassed, and 
the state set to Idle, the state machine routine and the filter are ready to be 
reassigned (in the same frame if necessary) to another frequency, 
5 Consequently, the notch filter will no longer function at that candidate 
frequency. If the magnitude of the frequency has been sufficiently reduced by 
more than TESTDROP, then in step 1111, the filtering state flag is set. In 
either situation, the logic continues with at step 1116. 

In step 1116, the state flag is checked to determine if it has been set to 

10 filtering (to determine if the notch filter is currently filtering a feedback 
frequency). If so, a check is performed in step 1118 to determine whether the 
notch filter is currently set to the same frequency or within a few bins of the 
new candidate frequency. Checking within a few bins of a candidate 
frequency creates a "deadband" each of candidate frequency to assure that 

15 additional candidate frequencies are not erroneously located around the main 
candidate frequency in future iterations. One embodiment of this routine 
uses 2 bins. 

If it is the same frequency (or close to the same frequency), the notch 
depth is increased in step 1120. If the current frequency is not the same as 

20 the candidate frequency, then the program exits so that the candidate 
frequency can be tested by another filter state machine. 

Referring back to step 1116, if the state flag is not set to the filtering 
state, then the logic proceeds to step 1121. Step 1121 tests the state flag to 
see if the filter is in the idle state. If the state flag is not in an idle state, the 

25 routine exits. If the state flag is set to the idle state, (indicating that the 
filter is bypassed), then in step 1122 new filter parameters are set. The filter 
parameters may include new frequency, bandwidth, and trial notch depth. 
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As those skilled in the art will realize, the bandwidth is a function of the 
speciific FFT length and windowing used. In one embodiment, the bandwidth 
is determined by the following pseudo code equation: 

Bandwidth (Octaves) = (WINDOW„SMEAR * SAMPLE_RATE / FFT_LEN) / 
5 Frequency(Hz) 

If (Bandwidth < MIN„BAND WIDTH), then BandWidth = MIN„BANDWIDTH 

In the above pseudo code routine, the variable "WINDOW_SMEAR" 

compensates for the smearing factor of FFT windowing. In the present 
10 invention, this is set to 2.1 for a Hann window, which is one of many windows 

that could be used with an FFT analysis. The SAMPLE_RATE is 48000, the 

FFT_LEN is 4096, and the MIN_BANDWIDTH is 0.05. The notch filters 

could also be set to a predetermined bandwidth if a FFT is used with 

sufficient resolution and over a given sensible frequency range of operation. 
15 One embodiment uses a trial notch depth of 6dB. The trial notch depth is 

increased in depth in steps of 6dB when feedback is detected at the same 

frequency as the one already being filtered. 

In step 1123, the variable FREQUENCY_ASSIGNED is now set to 

"true." This variable is passed to assignment process 420 to indicated that 
20 this state machine has now been assigned a new frequency. The timer is 

reset to zero and started in step 1124. In step 1126, the state flag is set to 

testing and the subroutine exits. 

After being modified by the notch filters 407, the resulting signal is 

passed to the DAC 108 for conversion back to the analog domain, the 
25 resulting signal being passed ultimately to the amplifier 110 and loudspeaker 

112 for reproduction. 

In sum, the present embodiment is very effective at picking lingering 

tones out of a noisy (music) background. The process ensures that 
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frequencies that are not continuous (and are thus probably music signals) are 
not considered for candidature. A tone must be present continuously for a 
period of time before becoming a candidate. Also, the rate at which the tone 
build up in the balHstics memory is dependent on the amplitude of the tone, 

5 so a high level tone is acted on more urgently than low level ones. 

Once the candidate frequencies are selected by the frequency selection 
process, the implementation process continuously tests candidate frequencies 
by applying trial notch filters at the candidate frequency. If there are good 
results, then the frequency is determined to be the result of acoustic 

10 feedback. If there are poor results, then the frequency is determined to be a 
result of a wanted signal (e.g. music or speech etc), so the notch filter is 
removed. 

The present embodiment, therefore, dynamically guards against 
feedback in applications where the conditions are continuously changing, 
15 such as where a microphone is mobile, and is being moved around in the 
same environment as the loudspeaker(s). 
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WHAT IS CLAIMED: 

1. A method of eliminating acoustical feedback in a system comprising: 
determining at least one parameter for at least one notch filter, 

adjusting the notch filter based on the at least one parameter, 

processing acoustic signals through the notch filter, 

testing an effect of the notch filter in the system, and 

removing the notch filter if the effect is less than a predetermined 
value. 

2. The method of claim 1 wherein the determining step comprises: 

converting the acoustic signals by a Fourier transform algorithm into 
at least one frequency spectrum comprising a plurality of frequency 
bins, 

selecting at least one frequency bin to be a candidate frequency bin, 

discriminating the candidate frequency bin to determine if the 
candidate frequency bin indicates acoustic feedback, and 
determining at least one notch filter parameter based on the candidate 
frequency. 

3. The method of claim 2 wherein the selecting step comprises: 

calculating a plurality of prominence values corresponding to a plurality 
of balUstics histories for the plurality of frequency bins wherein the 
prominence values with decreasing histories are reduced, and 
selecting at least one frequency bin to be at least one candidate 
frequency bin based on the prominence values of the ballistics history of 
the respective frequency bin. 
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4. The method of claim 2 wherein the discriminating step further 
comprises comparing each of the candidate frequency bins to a 
predetermined magnitude, if the respective candidate frequency bin 
value is less than the predetermined magnitude, removing the 
candidate frequency bin from the selection process. 

5. The method of claim 1 wherein the testing step comprises: 

determining whether the magnitude at a frequency bin being tested 
has been reduced by at least a predetermined value, if not, removing 
the notch filter, and 

comparing the frequency parameter to previous frequency parameters, 
if the frequency parameter is within a predetermined value of previous 
frequency parameters, increasing a notch depth parameter by a 
predetermined amount. 

6. The method of claim 1 wherein the adjusting step comprises: 

setting the notch filter to a candidate frequency, 

setting the notch filter to a bandwidth based on the candidate 
frequency, and 

setting the notch filter to a predetermined notch depth. 
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Abstract 

A method and system is provided for eliminating acoustical feedback in 
a system. The method determines a parameter for at least one notch filter, 
adjusting the notch filter based on the parameter, processing the digital 
signals through the notch filter, testing at the effect of the notch filter in the 
system, and removing the notch filter if the notch filter is not effective. Also 
disclosed is a method and system of selecting candidate frequencies which 
might be feedback, as opposed to other wanted sound frequencies. The 
selection method samphng the digital signals, converting the time domain 
digital signal samples by a fast Fourier transform algorithm into the 
frequency domain, using a ballistics approach to find prominences in the 
frequency spectrum, and testing the sizes of the prominences. 
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